Image file management system and imaging device with tag information in a communication network

ABSTRACT

An image management server including a receiver configured to receive an image file. The image file includes image data, copyright information, and tag information including route information for transmitting the image data. The image file is transmitted by an external device in accordance with the route information. The image management server further includes a processor configured to add digital watermark information to the image data to make the image file in a state in which the copyright information is protected or waived, and a transmitter configured to transmit the image file to an image display server in the state in which the copyright information in the image file is protected or waived.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.14/141,153, filed on Dec. 26, 2013 and is based upon and claims thebenefit of priority from Japanese Patent Application No. 2013-027175,filed on Feb. 14, 2013, the entire contents of which are incorporatedherein by reference.

FIELD OF THE INVENTION

The disclosure relates to a computer readable recording medium, atransmitting device, a management server, and an image transmittingmethod.

BACKGROUND

In imaging devices such as digital cameras, a technique of applyingcopyright information to captured image data has been known. In thistechnique, a photographer's name, a photographer's handwrittensignature, a photographer's ID, and the like are given to the capturedimage data as copyright information, and recorded on a recording medium.

Social networking services (SNS) and photo sharing websites arecurrently gaining a growing number of users to connect with other usersall over the world. For example, a server providing SNS causes postinginformation from an account followed by a user to be displayed on a website of another user provided by the server. In other words, byfollowing other people's accounts, a user causes posting informationpublished by the followed accounts to be displayed on his/her web site.

The embodiments of the invention described herein solve a need in theart for protecting personal information or copyrighted works transmittedto a server, such as a SNS.

SUMMARY

In accordance with some embodiments, an image file recorded on acomputer readable recording medium, a transmitting device, a managementserver, and an image transmitting method are presented.

In some embodiments, an image file recorded on a non-transitory computerreadable recording medium is presented. The image file is readable by atransmitting device in communication with a plurality of transceivingdevices. The image file includes electronic image data, and taginformation including transmission route information for transmittingthe image file to at least one of the plurality of transceiving devices.

In some embodiments, a transmitting device is capable of generating animage file including image data and communicating with a plurality oftransceiving devices. The transmitting device includes a tag informationadding unit configured to add, to the image file, tag informationincluding transmission route information for transmitting the image fileto at least one of the plurality of transceiving devices, and acommunication unit configured to perform transmission to one of theplurality of transceiving devices based on the transmission routeinformation.

In some embodiments, a management server communicates with a pluralityof servers via a network. The management server includes a managementserver communication unit that acquires an image file from an imagingdevice in which image data and tag information are recorded, includinginformation identifying the imaging device and mobile terminalinformation associated with the device, and transmits confirmationinformation of a copyright to a mobile terminal associated with thedevice based on the mobile terminal information.

In some embodiments, a transmitting device generates an image file andcommunicates with an image display transceiver. The transmitting deviceincludes a shooting condition tag information determining unit thatdetermines shooting tag information for image shooting which is added tothe image file by determining whether the image display transceiverperforms an image display using a first route or a second route as atransmission route of the image file, and a communication unit thattransmits the image file through one of the first route and the secondroute.

In some embodiments, generates an image file and communicates with animage display device. The transmitting device includes a communicationunit that transmits the image file, a shooting condition tag informationdetermining unit that determines shooting tag information for imageshooting which is added to the image file, and a communicationdetermining unit that determines which of a first route and a secondroute is used to transmit the image file to the image display device asa transmission route of the image file according to the shooting taginformation added to the image file.

In some embodiments, an image transmitting method is executed by atransmitting device that generates an image file including image dataand communicates with another device via a network. The method includesadding, to the image file, transmission route information of atransmission route as tag information, determining whether to delete thetag information when the image file is published according to userinstructions, and transmitting the image file to a receiving device forimage publication according to the transmission route informationincluded in the tag information.

In some embodiments, a non-transitory computer readable recording mediumwith an executable program recorded thereon is presented. The programinstructs a transmitting device having a processor to execute:communication with another device and transmission of an image file inwhich content data is recorded; adding transmission route information astag information to the image file for transmitting the image file to bepublished via the Internet; and transmitting the image file to one of aplurality of receiving devices based on the transmission routeinformation.

In some embodiments, a non-transitory computer readable recording mediumwith an executable program recorded thereon is presented. The programinstructs a management server having a processor to: transmitconfirmation information to an external device associated with animaging device based on transmission destination information of theexternal device among pieces of information included in tag informationadded to the image file transmitted from a transmitting device thatgenerates the image file in which image data is recorded; generatedigital watermark information on at least part of the tag informationbased on confirmed information transmitted from the external device as aconfirmation result on the confirmation information, and add the digitalwatermark information to the image file; and cause the image fileincluding the digital watermark information to be published via theInternet based on route information of a transmission route of the imagefile passing through the management server, which is included in the taginformation.

The above and other features, advantages and technical and industrialsignificance of this invention will be better understood from thefollowing detailed description in connection with the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating a configuration of anexemplary image communication system according to some embodiments;

FIG. 2 is a front perspective view of an imaging device illustrating afront side of the imaging device that faces a subject according to someembodiments;

FIG. 3 is a rear perspective view of the imaging device illustrating aback side of the imaging device that faces a user (photographer)according to some embodiments;

FIG. 4 is a block diagram illustrating a functional configuration of theimaging device according to some embodiments;

FIG. 5 is a diagram illustrating an exemplary configuration of an imagefile recorded on an image data recording unit of the imaging deviceaccording to some embodiments;

FIG. 6 is a block diagram illustrating a functional configuration of animage reception server according some embodiments;

FIG. 7 is a block diagram illustrating a functional configuration of amanagement server according to some embodiments;

FIG. 8 is a diagram illustrating an exemplary configuration of atransmission image file recorded on a transmission image data recordingunit of the management server according to some embodiments;

FIG. 9 is a block diagram illustrating a functional configuration of animage display server according to some embodiments;

FIG. 10 is a block diagram illustrating a functional configuration of amobile device according to some embodiments;

FIG. 11 is a diagram illustrating an outline of a copyright waiver modeexecuted by the image communication system according to someembodiments;

FIG. 12 is a diagram illustrating an outline of a copyright protectionmode executed by the image communication system according to someembodiments;

FIG. 13 is a flowchart of a detailed process executed by the imagingdevice according to some embodiments;

FIG. 14 is a perspective view of a user taking a picture of a subjectusing the imaging device according to some embodiments;

FIG. 15 illustrates an exemplary image displayed on a display unit ofthe imaging device according to some embodiments;

FIG. 16 is an explanatory diagram illustrating an outline of a distancedetecting method performed by a distance distribution detector of theimaging device according to some embodiments;

FIG. 17 illustrates an exemplary image displayed on the display unit ofthe imaging device according to some embodiments;

FIG. 18 is a flowchart illustrating an outline of a portrait rightpermission process shown in FIG. 13;

FIG. 19 is a perspective view of a subject permitting portrait rights;

FIG. 20A is a perspective view of a subject permitting portrait rightsusing the imaging device according to some embodiments;

FIG. 20B is a perspective view of a subject permitting portrait rightsusing the imaging device according to some embodiments;

FIG. 21 is a flowchart illustrating a detailed process executed by theimage reception server according to some embodiments;

FIG. 22 is a flowchart illustrating a detailed process executed by themanagement server according to some embodiments;

FIG. 23 is a flowchart illustrating a detailed process executed by theimage display server according to some embodiments;

FIG. 24 illustrates an exemplary image on a designation page includingcopyright information in the image display server according to someembodiments; and

FIG. 25 illustrates an exemplary image on a copyright free designationpage in the image display server according to some embodiments.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Exemplary embodiments will be described with reference to theaccompanying drawings where the same components are denoted by the samereference numerals.

FIG. 1 is a schematic diagram illustrating a configuration of an imagecommunication system 1 according to some embodiments.

The image communication system 1 illustrated in FIG. 1 preferablyincludes an imaging device 100, an image reception server 200, amanagement server 300, an image display server 300, and one or mobiledevices 500, 600. The imaging device 100 images a subject to generateimage data and transmits an image file including the image data to theoutside via a network N. The image reception server 200 receives theimage file transmitted from the imaging device 100 via the network N andtransmits the image file to a server corresponding to tag information ofroute information of a transmission route of the image file, includingat least some of a plurality of servers which are attached to the imagefile. The management server 300 manages the image file based on taginformation attached to an image file transmitted from a server incommunication with the imaging device 100 via a network. The imagedisplay server 400 receives the image file from the image receptionserver 200 or the management server 300 via the network N and transmitsposting information such as image data or content data according toaccess from a mobile device 500 or a mobile device 600 which will bedescribed later. The mobile device 500 and the mobile device 600 canaccess the image display server 400 via the network N or receiveinformation from the management server 300. As described herein, themobile device 600 can have the similar features and functionality to themobile device 500. In some embodiments described herein, the imagingdevice 100 functions as a transmitting device or a communication device.

The imaging device 100 is described with reference to FIGS. 2-4. FIG. 2is a front perspective view of the imaging device 100 illustrating afront side of the imaging device 100 that faces a subject. FIG. 3 is arear perspective view of the imaging device 100 illustrating a back sideof the imaging device 100 that faces a user (photographer). FIG. 4 is ablock diagram illustrating a functional configuration of the imagingdevice 100.

The imaging device 100 illustrated in FIGS. 2 to 4 preferably includesan imaging unit 101, a position acquiring unit 102, an input unit 103, adisplay unit 104, a touch panel 105, a clock 106, a user informationdetector 107, a recording unit 108, a communication unit 109, and acontrol unit 110.

The imaging unit 101 captures an image of a subject and generates imagedata of the subject under control of the control unit 110. The imagingunit 101 preferably includes an optical system 101 a, an imaging element101 b, and a signal processing unit 101 c.

The optical system 101 a collects light from a specified field of viewarea. The optical system 101 a preferably includes a zoom functioncapable of changing a focal distance, a focus function capable ofadjusting a focus, a shutter, a diaphragm, and the like. The opticalsystem 101 a changes a focal distance, adjusts a focus, changes anaperture value, or sets a shutter speed in response to an instructionsignal input from the control unit 110.

The imaging element 101 b receives light collected by the optical system101 a, converts the light into an electrical signal, and outputs theelectrical signal to the signal processing unit 101 c. The imagingelement 101 b is configured using a CCD (Charge Coupled Device), a CMOS(Complementary Metal Oxide Semiconductor), or other image sensor thatreceives light collected by the optical system 101 a and converts thelight into an electrical signal. The imaging element 101 b sequentiallygenerates image data at a specified frame rate, for example, at 30 fpsor 60 fps, in response to the instruction signal input from the controlunit 110.

The signal processing unit 101 c executes an analog process such as anoise reduction process and a gain up process and A/D conversion on ananalog signal output from the imaging element 101 b, and outputsresultant data to the control unit 110.

The position acquiring unit 102 receives orbital information ofsatellites transmitted from a plurality of GPS satellites configuring aGPS (Global Positioning System) that is a measuring system for measuringthe position of an object on the ground. The position acquiring unit 102preferably acquires positional information of the imaging device 100 atthe time of capturing or image playback based on the received orbitalinformation and outputs the positional information to the control unit110. The positional information includes, for example, longitude,latitude, and time information.

The input unit 103 preferably includes a power switch 103 a thatreceives an input of an instruction signal indicating power-on orpower-off of the imaging device 100, a release switch 103 b thatreceives an input of a release signal instructing the imaging device 100to perform shooting, an operating switch 103 c that receives an input ofan instruction signal for changing settings of various kinds ofparameters of the imaging device 100, and a mode selector switch 103 dthat changes a mode of the imaging device 100. The release switch 103 bpreferably moves up or down when pushed down from the outside, receivesan input of a first release signal instructing the imaging device 100 toperform a shooting preparation operation when pushed down halfway, andreceives an input of a second release signal instructing the imagingdevice 100 to perform still image shooting when pushed down fully.

The display unit 104 preferably displays a live view image correspondingto image data imaged by the imaging unit 101, an image corresponding toimage data that has been subjected to image processing executed by animage processing unit 110 a, and an image corresponding to image datarecorded in the recording unit 108. The display unit 104 is preferablyconfigured using a display panel such as a liquid crystal panel or anorganic EL (Electro Luminescence) panel. Examples of the image displayinclude a rec view display in which image data immediately aftershooting is displayed during a specified period of time (for example, 3seconds), a playback display in which image data recorded in therecording unit 108 is played back, and a live view image display inwhich live view images corresponding to image data consecutivelygenerated by the imaging unit 101 are sequentially displayed in timeseries. The display unit 104 can also display operation information ofthe imaging device 100, information on shooting such as an exposurevalue or an aperture value, and other information that would be usefulto the user.

The touch panel 105 is disposed on a display screen of the display unit104. The touch panel 105 detects a touch position of a finger, a touchpen, or any other external object, and outputs a positional signalcorresponding to the detected touch position to the control unit 110.The touch panel 105 detects the position which the user touches based oninformation displayed on the display unit 104, and receives an input ofan instruction signal instructing an operation to be performed by theimaging device 100 according to the detected touch position. The touchpanel 105 can be a resistive type, a capacitive type, an optical type,or other known touch panels in the art. In some embodiments, a touchpanel of any type can be applied. In some embodiments discussed herein,the touch panel 105 functions as a permission information input unitthat receives an input of permission information on portrait rights of asubject.

The clock 106 has a clock function and a shooting date and timedetermining function. The clock 106 outputs date and time data to thecontrol unit 110 in order to correlate date and time data to image dataimaged by the imaging unit 101.

The biological information detector 107 is preferably disposed on theoutside of the imaging device 100. The user information detector 107 canbe a biological information detector that detects biological informationof a photographer when image data is generated by the imaging device100. More particularly, the biological information detector can detectbiological information used to perform personal authentication such asthe photographer's fingerprint, vein, muscle current, or otherbiological information. The biological information detector 107 isconfigured, for example, using a biological information sensor capableof performing personal authentication such as a fingerprint detectingsensor, a vein detecting sensor, a muscle current sensor, or the like.Further, the biological information detector 107 can detect biologicalinformation of the subject when touched from the outside. The biologicalinformation detector 107 can detect any one of a vocal print, a secretcode, a user ID, and a password. The biological information detector 107can also perform face authentication through a small-sized camera. Inother words, the biological information detector 107 may be applied toan imaging unit having a face determining function of capturing theuser's face and detecting a feature point of the user's face.

The recording unit 108 records, for example, various kinds of programsfor operating the imaging device 100 and various kinds of data orparameters used when the program is being executed. The recording unit108 preferably includes a program recording unit 108 a, an image datarecording unit 108 b, an access destination information recording unit108 c, and a personal information recording unit 108 d. The programrecording unit 108 a stores the programs executed by the imaging device100. The image data recording unit 108 b records image data, imageprocessing information used when image data is developed, imaginginformation used when image data is imaged, thumbnail image data, and animage file associated with tag information used for personalauthentication. The access destination information recording unit 108 crecords identification information (IP address) of the imaging device100 necessary to perform wireless communication with another imagereception server 200, a password corresponding to the identificationinformation, an account used when content data including an image fileis transmitted to the image reception server 200, an IP address of theimage reception server 200, and the like. The personal informationrecording unit 108 d records owner information indicating an owner ofthe imaging device 100 and confirmation destination information for themobile device 500 associated with the imaging device 100. Examples ofthe confirmation destination information include, without limitation, amail address used to transmit mail to the mobile device 500, a telephonenumber, and owner information of the mobile device 500. The recordingunit 108 is configured with a semiconductor memory such as flash memoryor DRAM (Dynamic Random Access Memory).

The image file F100 recorded in the image data recording unit 108 b isdescribed in detail herein with respect to FIG. 5, which is an exemplaryconfiguration of the image file F100.

The image file F100 illustrated in FIG. 5 preferably includes an imagedata storage area F10 that stores image data F1, a header informationstorage area F20 that stores header information according to a formatconforming to Exif (Exchangeable image file format), and a taginformation storage area F30 that stores tag information used forpersonal authentication when an image file is transmitted to the outsidevia the network N.

The header information storage area F20 preferably records (stores)thumbnail image data F21 (JPEG format), image processing information F22that records an image processing parameter used when image data isdeveloped by the image processing unit 110 a, and imaging informationF23 in which a focal distance, an aperture value, an exposure value, ISOsensitivity, white balance, shutter speed, and the like are used whenimage data is imaged are recorded.

The tag information storage area F30 preferably stores or recordsbiological information F31 detected by the biological informationdetector 107, positional information F32 acquired by the positionacquiring unit 102, a time F33 input from the clock 106, distancedistribution information F34 indicating the distribution of distancesfrom the imaging device 100 to the subject in a specified row of pixelsof an image corresponding to image data, permission ID information F35indicating presence or absence of permission of portrait rights of asubject in an image, device identification information F36 indicatingidentification information of the imaging device 100, confirmationdestination information F37 of the mobile device 500 of the owner of theimaging device 100, and route information F38 of transmission route ofan image file including at least some of a plurality of servers. Asdescribed above, it is often convenient to provide a lot of taginformation to the photographer, user, his/her family or friends, orother persons having access to the image. However, as the amount ofinformation increases, privacy issues may arise, and particularly, foran image uploaded to a network accessible by a large indefinite numberof viewers, a person who infringes a right innocently or with maliciousintent may utilize the information in a way different from a rightholder's intention. The imaging device 100 according to some embodimentsherein deletes or removes the tag information (particularly, an itemcapable of tracking an individual's activity such as when, where, andwho) depending on a situation prior to transmitting the resultant data.

Referring again to FIGS. 2-4, the communication unit 109 preferablyperforms wireless communication with any one of the image receptionserver 200, the management server 300, the image display server 400, andthe mobile device 500 according to a specified wireless communicationstandard, and transmits an image file or content data to any one of theimage reception server 200, the management server 300, the image displayserver 400, and another mobile device 500. Examples of the specifiedwireless communication standard include, without limitation, IEEE802.11band IEEE802.11n. In some embodiments herein, any wireless communicationstandard can be applied. The communication unit 109 preferably receivescontent data, error information, an IP address, and a password (keyinformation) from any one of the management server 300, the imagedisplay server 400, and the mobile device 500. The error information isinformation indicating that confirmation destination informationtransmitted from the management server 300 through the image receptionserver 200 (described herein) is not added when the confirmationdestination information is not recorded in the tag information of animage file when the image file is transmitted. The communication unit109 transmits an image file including at least route informationincluding among pieces of tag information of an image file to betransmitted to any one of a plurality of servers according to routeinformation.

The communication unit 109 is preferably configured using acommunication device that performs wireless communication with any oneof the management server 300, the image display server 400, and themobile device 500 via the network N and performs two-way communicationof an image file, content data, or various kinds of information. Thecommunication device is preferably configured using an antenna thattransceives a radio signal with another device, a transceiving circuitthat performs a demodulation process of demodulating a received signaland a modulation process of modulating a signal to be transmitted, andthe like.

When the imaging device 100 is activated, the communication unit 109periodically transmits a communication signal with identificationinformation (device ID) for notifying of the presence thereof. Thecommunication unit 109 receives a communication signal transmitted fromany one of the management server 300, the image display server 400 andthe mobile device 500, returns from a stopped status or a standbystatus, and establishes communication with any one of the managementserver 300, the image display server 400, and the mobile device 500. Thecommunication unit 109 returns from the stopped status or the standbystatus when entering the mode of the imaging device 100, such as, forexample, the playback mode or the communication mode. The communicationunit 109 may be incorporated into a recording medium such as a memorycard mounted from the outside of the imaging device 100. Thecommunication unit 109 may also be installed as an accessory mounted inthe imaging device 100 through a hot shoe.

The control unit 110 transfers a corresponding instruction or data tothe components configuring the imaging device 100, for example,according to an instruction signal input from the input unit 103 or thepositional signal input from the touch panel 105, and controls anoperation of the imaging device 100 in general. The control unit 110 isconfigured using a CPU (Central Processing Unit) or the like.

A detailed configuration of the control unit 110 will be described. Thecontrol unit 110 preferably includes the image processing unit 110 a, aface detector 110 b, a distance distribution detector 110 c, a taginformation adding unit 110 d, a tag information deleting unit 110 e, adisplay controller 110 f, a candidate determining unit 110 g, a shootingcondition tag information determining unit 110 h, and a communicationdetermining unit 110 i.

The image processing unit 110 a acquires the image data generated by theimaging unit 101 or image data (raw data) recorded in the recording unit108, and generates image data (processed image data) obtained byexecuting various kinds of image processing on the acquired image data.The image data is output to the recording unit 108 through the controlunit 110. The image processing unit 110 a is configured using an imageengine.

The face detector 110 b preferably detects a face of a person includedin an image corresponding to image data by pattern matching. Moreparticularly, the face detector 110 b detects the position of the face,the size of the face, a direction of the face, an angle (inclination) ofthe face, and the like by detecting the position of the face in an imageby pattern matching and then detecting the positions of features of theface such as the eyes, the ears, and the mouth. When the face in theimage is detected, the face detector 110 b detects the eyes, the ears,the mouth, and the size of the face as feature points of the face. Theface detector 110 b may detect a face of an animal or the like as wellas a face of a person. In addition, the face detector 110 b may detect aface of a person using a known technique other than pattern matching.

The distance distribution detector 110 c detects distance distributioninformation indicating the distribution of distances from the imagingdevice 100 to the subject when a specified row of pixels in an imagecorresponding to image data is used as a reference. More particularly,the distance distribution detector 110 c detects the distance of each ofa plurality of focus points, and detects distance distributioninformation from the imaging device 100 to the subject. Here, thedistance distribution information may be information obtained when theimaging device 100 is brought into focus, focus positional information,or relative comparative information. The distance distribution detector110 c does not have to perform accurate measurement and may only provideinformation about a near-far relation. Alternatively, the distancedistribution detector 110 c may only provide information about alandscape and a close range, and may determine and detect even alandscape in a poster or the like as a short distance as opposed to along distance. Further, for focusing, a hill-climbing method, a phasedifference method, and the like are generally used, but face sizeinformation or blur information can also be used.

The tag information adding unit 110 d adds tag information to an imagefile. The tag information preferably includes route information fortransmitting the image file to at least one of a plurality of servers.More particularly, the tag information adding unit 110 d generates thebiological information F31, the positional information F32, the timeF33, the distance distribution information F34, the permission IDinformation F35, the device identification information F36, theconfirmation destination information F37, and the route information F38in the tag information storage region F30 recorded in the image fileF100, and adds the information to the image file as the tag information.

When the communication unit 109 transmits the image file to any one of aplurality of servers, the tag information deleting unit 110 e preferablydeletes, blocks, or removes the tag information other than routeinformation based on the route information of the tag information of theimage file. Preferably, the tag information deleting unit 110 e deletesthe biological information F31, the positional information F32, the timeF33, the distance distribution information F34, the permission IDinformation F35, the device identification information F36, and theconfirmation destination information F37 which are recorded in the taginformation storage area F30 in the image file F100. Alternatively, thetag information deleting unit 110 e can delete only tag informationspecified by an individual such as the biological information F31, thepositional information F32, the permission ID information F35, and theconfirmation destination information F37. For an image uploaded to anetwork accessible by a large indefinite number of viewers, a person whoinfringes a right innocently or with malicious intent may utilize theinformation in a way different from a right holder's intentions, andthus, it is safer to delete or remove the tag information (particularly,an item capable of tracking an individual's activity such as when,where, and who) depending on a situation prior to transmitting theresultant data. In most cases, it is better to delete, block, or removeall information related to a subject or location.

The display controller 110 f controls a display form of the display unit104. The display controller 110 f causes various kinds of information ofthe imaging device 100 to be displayed on the display unit 104.

The candidate determining unit 110 g determines whether or not a facedetected in an image by the face detector 110 b is a specific face. Moreparticularly, the candidate determining unit 110 g determines whether ornot a feature point of a face detected by the face detector 110 bmatches a feature point of a face of a person, such as a family memberor other person known to an owner of the imaging device 100, or afeature point of a pet which is registered in advance.

The shooting condition tag information determining unit 110 h decideswhether the image display server 400 performs an image display using afirst route (a route 1) or a second route (a route 2) as a transmissionroute of an image file, and decides shooting tag information at the timeof shooting which is added to the image file by the tag informationadding unit 110 d. Here, the shooting tag information at the time ofshooting refers to the biological information F31, the positionalinformation F32, the time F33, the distance distribution informationF34, the permission ID information F35, and the device identificationinformation F36.

The communication determining unit 110 i decides which of the firstroute, for example, route 1 or route 2, is used to transmit the imagefile to the image display server 400 as the transmission route of theimage file according to the shooting tag information attached to theimage file. For example, when the shooting tag information attached tothe image file is the distance distribution information F34, thecommunication determining unit 110 i decides that the image file is tobe transmitted to the image display server 400 through the first routewhich will be described later, and adds the image file using thedecision as the route information.

Next, a configuration of the image reception server 200 will bedescribed with reference to FIG. 6, which is a block diagramillustrating a functional configuration of the image reception server200. The image reception server 200 illustrated in FIG. 6 preferablyincludes a communication unit 201, an image database 202, and an imagereception server controller 203.

The communication unit 201 preferably communicates with any one of theimaging device 100, the management server 300, the image display server400, and the mobile device 500 via the network N, and transmits an imagefile or content data to any one of the imaging device 100, themanagement server 300, the image display server 400, and the mobiledevice 500. The communication unit 201 also preferably communicates withany one of the imaging device 100, the management server 300, the imagedisplay server 400, and the mobile device 500, and receives image filerequest data, an IP address, account data (key information), and thelike.

The image database 202 preferably records the image file and the contentdata received from any one of the imaging device 100, the managementserver 300, the image display server 400, and the mobile device 500through the network N, the communication unit 201, and the imagereception server controller 203. The image database 202 is preferablyconfigured using a recording medium such as SDRAM or a hard discrecorder.

The image reception server controller 203 is preferably configured usinga CPU, and transmits the image file or the content data recorded in theimage database 202 in response to an access signal input from any one ofthe imaging device 100, the management server 300, the image displayserver 400, and the mobile device 500 through the network N and thecommunication unit 201. The image reception server controller 203preferably includes a forwarding destination setting unit 203 a.

The forwarding destination setting unit 203 a transmits the image fileF100 to a server of a transmission destination based on the routeinformation F38 of the tag information storage region F30 in the imagefile F100 received from the imaging device 100 through the network N andthe communication unit 201. For example, when the route information F38recorded in the image file F100 received from the imaging device 100represents “the route 1,” the forwarding destination setting unit 203 atransmits the image file F100 to the image display server 400, and whenthe route information F38 represents “the route 2,” the forwardingdestination setting unit 203 a transmits the image file F100 to themanagement server 300.

Next, a configuration of the management server 300 will be describedwith reference to FIG. 7, which is a block diagram illustrating afunctional configuration of the management server 300. The managementserver 300 illustrated in FIG. 7 preferably includes a communicationunit 301, a user database 302, an image database 303, and a managementserver controller 304.

The communication unit 301 preferably communicates with any one of theimaging device 100, the image reception server 200, the image displayserver 400, and the mobile device 500 according to a specifiedcommunication standard, and receives an image file or content data. Thecommunication unit 301 preferably transmits the tag information servingas confirmation information to the mobile device 500 based onconfirmation destination information of the mobile device 500 serving asan external device associated with the imaging device 100 among piecesof information included in the tag information of the image filereceived through the network N. The communication unit 301 alsotransmits an image file including digital watermark information to anyone of the imaging device 100, the image reception server 200, the imagedisplay server 400, and the mobile device 500 based on the routeinformation of the transmission route of the image file that is includedin the tag information of the image file and passes through themanagement server 300. In some embodiments, the communication unit 301functions as a server communication unit.

The user database 302 records personal authentication information whichis preferably recorded in advance. More particularly, the user database302 records owner information of the owner/operator of the imagingdevice 100, biological information of the owner/operator of the imagingdevice 100, portrait right information of the portrait right holder,biological information of the portrait right holder, and confirmationdestination information including, for example and without limitation, amail address or a telephone number of the mobile device 500 of thedevice owner/operator or the portrait right holder. The user database302 is configured using a recording medium such as SDRAM or a hard discrecorder.

The image database 303 records a received image file. The image database303 preferably includes a reception image data recording unit 303 a anda transmission image data recording unit 303 b.

The reception image data recording unit 303 a records an image filereceived from the image reception server 200. More particularly, thereception image data recording unit 303 a records an image file at thetime of transmission which is transmitted from the imaging device 100through the network N and the image reception server 200.

The transmission image data recording unit 303 b preferably records atransmission image file in which tag information used for personalauthentication by the management server controller 304 (describedhereafter) is added to an image file as digital watermark information.For digital watermarking of tag information, tag information may beincluded as digital watermark information. In addition informationassociated with tag information or information obtained by encryptingtag information may be included as digital watermark information. As adigital watermark technique, it is preferable that the above-mentionedinformation be converted into a form of a text code, a number, or anidentifier and embedded in a spatial domain, a frequency domain, or thelike. A specific bit of a pixel value having specific color informationcan be embedded, or a spread spectrum technique, a patchwork technique,or the like can be appropriately used. Watermark information forfalsification prevention may be attached using the digital watermarktechnique.

The transmission image file recorded in the transmission image datarecording unit 303 b will be described with reference to FIG. 8 which isa diagram illustrating an exemplary configuration of a transmissionimage file.

A transmission image file F200 illustrated in FIG. 8 preferably includesan image data storage area F10 that stores image data F1, a headerinformation storage area F20 that stores header information, and a taginformation storage area F30 that stores tag information used forpersonal authentication when the image file is transmitted to theoutside through the network N.

The header information storage area F20 preferably records (stores) thethumbnail image data F21, the image processing information F22, and theimaging information F23 according to a format confirming to Exif.

The tag information storage area F30 preferably stores (records)biological information F31, positional information F32, a time F33,distance distribution information F34, permission ID information F35,device identification information F36, confirmation destinationinformation F37, route information F38, and sender ID information F39identifying a sender that has transmitted the image file.

Referring to FIG. 7, the management server controller 304 is configuredusing a CPU or the like, and transmits the transmission image filerecorded in the image database 303 in response to an access signal inputfrom any one of the imaging device 100, the image reception server 200,the image display server 400, and the mobile device 500 through thenetwork N and the communication unit 301. The management servercontroller 304 preferably includes an individual information settingunit 304 a, an individual information determining unit 304 b, a digitalwatermark generating unit 304 c, an image search unit 304 d, and a taginformation deleting unit 304 e.

The individual information setting unit 304 a preferably records the taginformation included in the image file received through the network Nand the communication unit 301 in a user database.

The individual information determining unit 304 b preferably determineswhether or not selection information selecting the tag informationreceived from the mobile device 500 through the network N matches thetag information for personal authentication included in the receivedimage file. The individual information determining unit 304 b alsopreferably determines whether or not the tag information included in theimage file received through the network N and the communication unit 301matches the personal authentication information including the ownerinformation, the biological information of the owner of the imagingdevice 100, the portrait right information of the portrait right holder,and the portrait right information of the portrait right holder which isrecorded in the user database 302.

When it is determined that the selection information received from themobile device 500 by the individual information determining unit 304 bmatches the tag information included in the received image file, thedigital watermark generating unit 304 c adds the tag informationcorresponding to the selection information to the image data as digitalwatermark information.

The image search unit 304 d preferably searches for a similar imagepresent on the network N using a model image received from the mobiledevice 500 through the network N, and transmits a deletion instructionsignal for deleting the similar image to a server that manages thesimilar image when there is the searched similar image.

The tag information deleting unit 304 e preferably deletes, blocks, orremoves the tag information of the image file when the communicationunit 301 transmits the image file. More particularly, the taginformation deleting unit 304 e deletes or removes the biologicalinformation F31, the positional information F32, the permission IDinformation F35, the device identification information F36, theconfirmation destination information F37, and the sender ID informationF39 from the tag information storage area F30 of the transmission imagefile F200. Further, the tag information deleting unit 304 e may deleteor remove only the tag information added to the image data as digitalwatermark information by the digital watermark generating unit 304 cfrom the tag information storage area F30 of the transmission image fileF200.

The image display server 400 will be described with reference to FIG. 9which is a block diagram illustrating a functional configuration of theimage display server 400. The image display server 400 illustrated inFIG. 9 preferably includes a communication unit 401, an image database402, and an image display server controller 403.

The communication unit 401 preferably communicates with any one of theimaging device 100, the image reception server 200, the managementserver 300, and the mobile device 500 according to a specifiedcommunication standard, and receives an image file or content data. Inaddition, the communication unit 401 preferably transmits an image fileor content data to any one of the imaging device 100, the imagereception server 200, the management server 300, and the mobile device500 through the network N.

The image database 402 preferably records an image file received fromthe image reception server 200 or the management server 300 through thenetwork N and the communication unit 401. The image database 402 isconfigured using a recording medium such as an SDRAM or a hard discrecorder.

The image display server controller 403 is preferably configured using aCPU or the like, and transmits a designation page (image file) of abrowser in response to an access signal input from any one of theimaging device 100, the image reception server 200, the managementserver 300, and the mobile device 500 through the network N and thecommunication unit 401.

The image display server controller 403 preferably includes a copyrightinformation adding unit 403 a, an image data deleting unit 403 b, anaccess determining unit 403 c, and a display controller 403 d.

When copyright information is included in the image file received fromthe management server 300 through the network N and the communicationunit 401, the copyright information adding unit 403 a preferably addsprohibition information that prohibits the image database 402 fromcopying any copyrighted information.

The access determining unit 403 c determines a device that has receivedan access signal through the network N and the communication unit 401.For example, the access determining unit 403 c determines whether or notthere has been access from the image reception server 200, themanagement server 300, or the mobile device 500.

Upon receiving a deletion signal indicating deletion of an image filefrom the management server 300 through the network N and thecommunication unit 401, the image data deleting unit 403 b preferablydeletes an image file represented by the deletion signal from the imagedatabase 402.

The display controller 403 d preferably controls a display form of adesignated designation page of a browser in response to an access signalinput from any one of the imaging device 100, the image reception server200, the management server 300, and the mobile device 500 through thenetwork N and the communication unit 401. For example, the displaycontroller 403 d displays an image corresponding to image data of animage file of the designated designation page. In addition, when theprohibition information is included in the image file of the designationpage, the display controller 403 d causes information indicating copyprohibition to be displayed on an image in a superimposed manner.

The mobile device 500 will be described with reference to FIG. 10 whichis a block diagram illustrating a functional configuration of the mobiledevice 500. When the owner of the mobile device 500 is the same as theowner of the imaging device 100, the owner of the mobile device 500 isassumed to have a right to know how his/her imaging device (camera) hasbeen used. When an imaging device is a rental device or a borroweddevice, there can be cases in which the device owner or lender does notgive a right to know how the imaging device (camera) has been used tothe renter or borrower, and a mobile device of the device owner orlender may be registered as the mobile device 500.

The mobile device 500 illustrated in FIG. 10 preferably includes acommunication unit 501, a display unit 502, a touch panel 503, anoperating unit 504, a recording unit 505, and a mobile device controller506.

The communication unit 501 preferably communicates with any one of theimaging device 100, the image reception server 200, the managementserver 300, and the image display server 400 according to a specifiedcommunication standard, and receives an image file or content data. Thecommunication unit 501 preferably transmits an image file or contentdata to anyone of the imaging device 100, the image reception server200, the image display server 400, and the image display server 400through the network N. In addition, the communication unit 501 canreceive a list of pieces of tag information used for personalauthentication from the management server 300.

The display unit 502 preferably displays an image corresponding to imagedata. The display unit 502 is preferably configured using a displaypanel such as a liquid crystal panel or an organic EL panel. The displayunit 502 preferably displays a list of pieces of tag informationreceived through the communication unit 501. More particularly, thedisplay unit 502 displays owner information of the owner of the imagingdevice 100 associated with the mobile device 500, for example, mailaddress information or telephone number information of the mobile device500, owner information of the imaging device 100, and portrait rightinformation. Further, the display unit 502 displays an image of adesignation page designated when access to the image display servercontroller 403 is made through the network N and the communication unit501.

The touch panel 503 is preferably disposed on a display screen of thedisplay unit 502. The touch panel 503 can detect the touch of a finger,a touch pen, or any other object from the outside, and outputs apositional signal according to the detected touch position to the mobiledevice controller 506. The touch panel 503 can also detect the positionwhich the user touches based on information displayed on the displayunit 502, and receives an input of an instruction signal instructing anoperation to be performed by the mobile device 500 according to thedetected touch position.

The operating unit 504 preferably receives an input of a selectionsignal for selecting various kinds of parameters of the mobile device500 or the personal authentication information.

The recording unit 505 preferably records image data and various kindsof programs executed by the mobile device 500. The recording unit 505 isconfigured using a semiconductor memory such as, and without limitation,flash memory or DRAM.

The mobile device controller 506 is preferably configured using a CPU orthe like, and transfers a corresponding instruction or data to thecomponents configuring the mobile device 500 according to the positionalsignal or input from the touch panel 503 or an instruction signal inputfrom the operating unit 504, and controls an operation of the mobiledevice 500 in general. The mobile device controller 506 preferablytransmits tag information selected according to the positional signalinput from the touch panel 503 to the management server 300 through thecommunication unit 501 and the network N. The user can make up forshooting tag information at the time of shooting based on the user'smemory through the mobile device 500. For example, the user may converttag information including such as tourist spot names in map informationinto information in which names of facilities in tourist spots arespecified or information indicating a user specific relation, such as“grandma's house,” using the mobile device 500. Similarly, even in dateand time information, for example, an idea such as replacement byspecial information such as “birth day” or “wedding anniversary” may beintroduced. As information individualization progresses as describedabove, the possibility of individual information leak increases, and theimportance of encryption and digital watermark techniques increases.

The mobile device 600 has the same configuration as the mobile device500, and the description of the configuration of the mobile device 600is not repeated.

The image communication system 1 having the above configuration may havea copyright waiver mode in which the copyright of an image fileincluding image data generated by the imaging device 100 is waived(copyright free) and a copyright protection mode in which the copyrightis protected. The image communication system 1 or the imaging device 100may change a transmission route of an image file by performing switchingbetween the copyright waiver mode and the copyright protection mode.

The copyright waiver mode, in which the copyright of the image filegenerated by the imaging device 100 is waived, executed in the imagecommunication system 1, will be described below with reference to FIG.11 which is a diagram illustrating an outline of the copyright waivermode executed by the image communication system 1.

Referring to FIG. 11, the imaging device 100 detects tag informationother than route information (the route 1) through the network N, andtransmits an image file to the image display server 400 through theimage reception server 200 (step S1) (the route 1).

The image reception server 200 that received the image file from theimaging device 100 transmits an image file according to the routeinformation included in the image file to the image display server 400(step S2). Thereafter, the image display server 400 causes the imagefile received from the image reception server 200 to be recorded in theimage database 402. Through this operation, the user can access theimage display server 400 using the mobile device 600, browse an image ofa designation page, select the image, and then freely acquire and copyimage data of the selected image through the mobile device 600 since thecopyright of the image file is waived (copyright free). However, becausethere is a possibility that the image is an improperly posted image thatinfringes a copyright or other right, it would be difficult to correct aunilateral deletion measure.

As described above, in the copyright waiver mode of the imagecommunication system 1, the image file in which the copyright is waivedcan be transmitted (posted) to the image display server 400 such thatthe tag information of the image file transmitted by the imaging device100 is deleted and then transmitted to the image display server 400through the image reception server 200. Because the imaging device 100deletes the tag information before transmitting the image file to theimage reception server 200, even when another user browses in thedesignation page of the image display server 400, personal informationcan be prevented from leaking.

The copyright protection mode, in which the copyright of the image filegenerated by the imaging device 100 is protected, executed by the imagecommunication system 1 will be described with reference to FIG. 12 whichis a diagram illustrating an outline of the copyright protection modeexecuted by the image communication system 1.

As illustrated in FIG. 12, the imaging device 100 preferably transmitsan image file including tag information to the image reception server200 through the network N (step S10). The tag information includes theroute information (the route 2) used to transmit the image file to theimage display server 400 through the image reception server 200 and themanagement server 300 and confirmation destination information servingas transmission destination information of the mobile device 500associated with the imaging device 100.

The image reception server 200 that has received the image fileincluding the tag information transmits the image file to the managementserver 300 according to the route information of the tag information ofthe image file (step S11).

The management server 300 that has received the image file from theimage reception server 200 preferably transmits a list of pieces of taginformation used for personal authentication to the mobile device 500corresponding to the confirmation destination information of the taginformation as the confirmation information through a mail (step S12).For example, the management server 300 transmits at least one of ownerinformation of the tag information, biological information, positionalinformation, copyright information, and portrait right information tothe mobile device 500 corresponding to address information of the taginformation as confirmation information through a mail. Any informationterminal with a communication function can be used as the mobile device.

The mobile device 500 that has received a list of pieces of taginformation as confirmed information transmits tag information selectedby the positional signal input from the touch panel 503 to themanagement server 300 (step S13). In this case, the mobile device 500transmits one or more pieces of tag information to the management server300.

The management server 300 that has received the tag information from themobile device 500 preferably generates digital watermark information ofthe tag information selected by the mobile device 500, adds the digitalwatermark information to the image data, and deletes tag informationcorresponding to the digital watermark information from the image file(step S14).

The management server 300 then transmits the image file in which thedigital watermark information of the tag information is added to theimage data to the image display server 400 (step S15) (the route 2).Thereafter, the image display server 400 causes the image file receivedfrom the management server 300 to be recorded in the image database 402.As a result, it is difficult for the user to access the image displayserver 400 using the mobile device 600, browse an image of a designationpage, select the image, and then acquire image data of the selectedimage through the mobile device 600 since copying is prohibited by thecopyright of the image file.

As described above, in the copyright protection mode of the imagecommunication system 1, the image file is transmitted to the imagedisplay server 400 through the image reception server 200, and themanagement server 300 according to the route information of the taginformation of the image file transmitted by the imaging device 100.Thus, the image file can be transmitted to the image display server 400in the state in which the copyright is protected.

Even when a user other than the owner of the imaging device 100, forexample, an assistant of the owner, captures an image using the imagingdevice 100, the owner of the imaging device 100 can transmit the imagefile to the image display server 400 in the state in which the copyrightof the image file is protected by selecting and approving the taginformation used for the personal authentication.

The management server 300 preferably generates digital watermarkinformation of the tag information selected by the mobile device 500 andtransmits the image file in which the tag information including thedigital watermark information is deleted to the image display server400, and thus, even when another user browses in the designation page ofthe image display server 400, personal information can be prevented fromleaking.

The transmission route of the image file may be switched by theabove-described mode switching, and the shooting condition taginformation determining unit 110 h decides whether the image displayserver 400 performs an image display using the first route (the route 1of FIG. 11) or the second route (the route 2 of FIG. 12) as atransmission route of an image file and decides shooting tag informationat the time of shooting which is added to the image file, and thecommunication unit 109 may transmit the image file to the image displayserver 400 through any one of the first and second routes via thenetwork N.

Alternatively, when an image file is generated, communication with theimage display server 400 may be performed via the network N such thattag information to be attached to an image to be displayed on a networkis decided in advance. In this case, the shooting condition taginformation determining unit 110 h may decide shooting tag informationat the time of shooting which is to be attached to the image file, thecommunication determining unit 110 i may decides which of the firstroute (for example, the route 1 of FIG. 11) and the second route (forexample, the route 2 of FIG. 12) is used to transmit the image file tothe image display server 400 as the transmission route of the image fileaccording to the shooting tag information attached to the image file,and then the image file may be transmitted through the communicationunit 109.

When shooting by the imaging device 100 is initiated, it is verydifficult to specify a person who has operated the imaging device 100 toperform shooting. In this regard, in some embodiments, a photographer oruser can be associated with the copyright in a one-to-one manner suchthat the imaging device 100 acquires information specifying a person(i.e., photographer) who has operated the imaging device 100 such asbiological information or input information of a photographer who hasoperated the imaging device 100 at the time of shooting, and theacquired information is added as tag information of captured image data.

There are cases in which a person (subject or model) to be captureddesires to tag, for example, waiver information of portrait rights toimage data (captured image) at the time of shooting, and in this case,it is necessary to match a person who has waived the portrait rightswith a person having the portrait rights. However, when the imagingdevice 100 acquires, for example, biological information including animage of a face of a person who has waived the portrait rights, inaddition to determination as to whether or not the image data matchesimage data of the person who has waived the portrait rights, by usingthe biological information (for example, fingerprint information or veininformation) of the person who has waived the portrait rights, so-calledspoofing in which the portrait right waiver is made by a person otherthan the portrait right holder can be reliably prevented.

Because biological information specifying a photographer having thecopyright or a subject having portrait rights is individual information,most photographers or subjects do not want individual informationspecifying an individual such as biological information published to thepublic. Therefore, an image file in which individual information, suchas biological information, is tagged as tag information needs to bestrictly managed.

As described above, special information that requires a photographer'scareful handling such as individual information (biological information)specifying a subject is processed only in a specially authenticatedserver, and thus the information is secure (this relates to routeinformation). However, because coordination with the mobile device 500(external device) associated with the owner of the imaging device 100 isperformed through a specific server (the management server 300), thesecurity can be further improved (this also relates to routeinformation).

As described above, confirmation of image publication to the Internet bythe owner of the imaging device 100 or management of photographer orsubject information can be properly performed according to atransmission route through which an image file is transmitted orprocessed. As a result, information or an image file generated by theimaging device 100 of some embodiments can be transmitted with a highrate of security.

Processes of each of the imaging device 100, the image reception server200, the management server 300, and the image display server 400described above will be described with reference to FIGS. 11 and 12.

First, a detail process executed by the imaging device 100 will bedescribed with reference to FIG. 13 which is a flowchart illustrating adetailed process executed by the imaging device 100.

As illustrated in FIG. 13, when the imaging device 100 is set to ashooting mode (Yes in step S101), the control unit 110 preferably causesa live view image corresponding to image data generated by the imagingunit 101 to be displayed on the display unit 104 (step S102). Asillustrated in FIGS. 14 and 15, a photographer or user K1 can check alive view image W1 displayed on the display unit 104 of the imagingdevice 100, and can perform shooting while adjusting composition on ashooting condition for a subject P1, for example, and withoutlimitation, any one of an aperture value, an exposure value, ISOsensitivity, white balance, a focus position, a shutter speed, and agradation through the operating switch 103 c.

When the face detector 110 b detects a face in the live view image W1(Yes in step S103), the tag information adding unit 110 d preferablyacquires a feature point of the face detected by the face detector 110 b(step S104). More particularly, when the face detector 110 b detects theface in the live view image W1 as illustrated in FIG. 15, the taginformation adding unit 110 d acquires a feature point of the detectedface. At this time, the display controller 110 f causes a frame F1corresponding to a facial area including the face detected by the facedetector 110 b to be superimposed on the live view image W1 anddisplayed on the display unit 104. After step S104, the imaging device100 causes the process to proceed to step S105.

When it is determined in step S103 that the face detector 110 b has notdetected a face in the live view image W1 (No in step S103), the imagingdevice 100 causes the process to proceed to step S105.

The tag information adding unit 110 d preferably acquires a time fromthe clock 106 at step S105, and acquires positional information from theposition acquiring unit 102 at step S106.

The tag information adding unit 110 d preferably acquires biologicalinformation of the photographer detected by the biological informationdetector 107 at step S107. More particularly, when the photographertouches the biological information detector 107 as illustrated in FIG.15, the tag information adding unit 110 d acquires the biologicalinformation of the photographer detected by the biological informationdetector 107. In this case, it is very important to specify thephotographer at the moment of shooting in terms of copyright managementbecause this information is likely to be closely connected with privacyand information requiring strict privacy protection. However, at thisstage, it is difficult to strictly protect this information in a mobiledevice such as the imaging device 100, and it can be difficult toconsistently install the latest version of this technique. In thisregard, in some embodiments, individual information (privacyinformation) can be protected using an appropriate technique in anoptimal environment at the time of transmission to the outside. Thedisclosed embodiments herein address the situation where the copyrightis closely connected with individual information.

As the release switch 103 b is operated to make a shooting operation(Yes in step S108), the distance distribution detector 110 c detectsdistance distribution information indicating the distribution ofdistances from the imaging device 100 to the subject when a specifiedone line of the live view image W1 in the horizontal direction is usedas a reference (step S109).

FIG. 16 is an explanatory diagram illustrating an outline of a distancedetecting method performed by the distance distribution detector 110 c.In the lower portion of FIG. 16, a vertical axis represents the distancefrom the imaging device 100 to the subject, and a horizontal axisrepresents the position of each pixel in one line (a straight line L10)of an image.

As illustrated in FIG. 16, the distance distribution detector 110 cpreferably scans a specified one line of the live view image W1 in thehorizontal direction, for example, one line (a row of pixels) includinga frame F1 corresponding to a facial area detected by the face detector110 b, and detects the distance distribution from the imaging device 100to the subject. More particularly, as illustrated in the upper portionof FIG. 16, the distance distribution detector 110 c scans the line L10on the live view image W1, and detects distance distribution informationL11 (in the lower portion of FIG. 16) from the imaging device 100 to thesubject.

Referring again to FIG. 13, in step S110, the control unit 110preferably causes the imaging device 100 to perform shooting. Moreparticularly, an operation of executing specified image processing onimage data (raw data) output from the imaging unit 101 is performed asthe imaging unit 101 is driven. As described above, image data that hasbeen subjected to image processing is recorded in the recording unit108.

The tag information adding unit 110 d preferably records tag informationin the image file in association with the image data at step S111.

The display controller 110 f preferably causes the image correspondingto the captured image data to be displayed on the display unit 104 atstep S112.

When a specified period of time, for example, 3 seconds elapses afterthe display unit 104 displays an image, (Yes in step S113), the imagingdevice 100 preferably causes the process to proceed to step S114.However, when the specified period of time does not elapse after thedisplay unit 104 displays an image (No in step S113), the imaging device100 preferably causes the process to return to step S112.

In step S114, the display controller 110 f ends an image display by thedisplay unit 104 (step S114).

When the imaging device 100 is in the power-off status (Yes in stepS115), the imaging device 100 preferably ends the present process.However, when the imaging device 100 is not in the power-off status (Noin step S115), the imaging device 100 preferably causes the process toreturn to step S101.

When it is determined in step S108 that the shooting operation has notbeen made (No in step S108), the imaging device 100 causes the processto return to step S101.

When it is determined in step S101 that the imaging device 100 is notset to the shooting mode (No in step S101) and the playback mode is set(Yes in step S116), the display controller 110 f preferably causes alist of image data recorded in the image data recording unit 108 b to bedisplayed on the display unit 104 (step S117).

When an image displayed on the display unit 104 is selected through thetouch panel 105 or the input unit 103 (Yes in step S118), the displaycontroller 110 f preferably causes the selected image to be displayed onthe entire screen of the display unit 104 (step S119).

When an image is changed by the touch panel 105 or the input unit 103(Yes in step S120), the imaging device 100 preferably causes the processto return to step S119. However, when an image is not changed throughthe touch panel 105 or the input unit 103 (No in step S120), the imagingdevice 100 preferably causes the process to proceed to step S121.

When it is determined in step S118 that an image displayed on thedisplay unit 104 is not selected through the touch panel 105 or theinput unit 103 (No in step S118), the imaging device 100 preferablycauses the process to proceed to step S121.

When the imaging device 100 ends the playback mode (Yes in step S121),the imaging device 100 preferably causes the process to return to stepS116. However, when the imaging device 100 does not end the playbackmode (No in step S121), the imaging device 100 causes the process toproceed to step S122.

When it is determined in step S122 that an image posting icon (notillustrated) receiving an input of an instruction signal for posting animage file of an image displayed on the display unit 104 to the imagedisplay server 400 has been operated (Yes in step S122), the imagingdevice 100 preferably causes the process to proceed to step S123 whichwill be described below. However, when an image posting icon receivingan input of an instruction signal for posting an image file of an imagedisplayed on the display unit 104 to the image display server 400 hasnot been operated (No in step S122), the imaging device 100 preferablycauses the process to return to step S118.

In step S123, the control unit 110 determines whether or not the imagingdevice 100 is set to the right waiver mode (step S123). Moreparticularly, the control unit 110 determines whether or not an icon(not illustrated) receiving an input of an instruction signal forwaiving the copyright for an image displayed on the display unit 104 hasbeen operated through the touch panel 105. When the control unit 110determines that the imaging device 100 is set to the right waiver mode(Yes in step S123), the imaging device 100 preferably causes the processto proceed to step S124 which will be described below. However, when thecontrol unit 110 determines that the imaging device 100 is not set tothe right waiver mode (No in step S123), the imaging device 100preferably causes the process to proceed to step S126 which will bedescribed below.

In step S124, the tag information deleting unit 110 e preferably deletesor removes tag information excluding route information recorded in animage file to be transmitted. The tag information deleting unit 110 emay change tag information to be deleted according to route information.For example, the tag information deleting unit 110 e may selectivelydelete only biological information of tag information, positionalinformation, and confirmation destination information.

The communication unit 109 preferably transmits the image file in whichthe tag information excluding the route information is deleted orremoved by the tag information deleting unit 110 e to the imagereception server 200 through the network N (step S125). In this case, asillustrated in FIG. 17, the display controller 110 f may causeinformation (message) indicating that the copyright for an image W1displayed on the display unit 104 is waived to be displayed on thedisplay unit 104. Thus, the photographer can intuitively understand thatthe copyright of the captured image is waived. After step S125, theimaging device 100 causes the process to proceed to step S115.

In step S126, when the face detector 110 b detects a face in the image(Yes in step S126), the imaging device 100 preferably executes aportrait right permission process of attaching presence/absence ofportrait right permission to the face in the image (step S127).

FIG. 18 is a flowchart illustrating an outline of the portrait rightpermission process of step S127 of FIG. 13. As illustrated in FIG. 18,the candidate determining unit 110 g preferably determines whether ornot the face detected in the image by the face detector 110 b is aspecific face (step S201). More particularly, the candidate determiningunit 110 g determines whether or not a feature point of a face detectedby the face detector 110 b matches a feature point of a face of a familymember of the owner of the imaging device 100 or a feature point of apet which is registered in advance. When the candidate determining unit110 g determines that the face detected in the image by the facedetector 110 b is the specific face (Yes in step S201), the imagingdevice 100 causes the process to proceed to step S202 which will bedescribed below. However, when the candidate determining unit 110 gdetermines that the face detected in the image by the face detector 110b is not the specific face (No in step S201), the imaging device 100causes the process to proceed to step S203 which will be describedbelow.

In step S202, the tag information adding unit 110 d preferably adds taginformation indicating that the face (subject) in the image is portraitright free (portrait right waived) to the tag information of the imagefile. After step S202, the imaging device 100 causes the process toreturn to the main or start routine of FIG. 13.

When it is determined in step S203 that the face in the image displayedon the display unit 104 is touched (Yes in step S203) and then thebiological information detector 107 detects biological information (Yesin step S204), the tag information adding unit 110 d preferably adds afeature point of the touched face in the image displayed on the displayunit 104 and the biological information detected by the biologicalinformation detector 107 as the tag information (step S205). Moreparticularly, when the subject P1 touches his/her facial area F1 on theimage W1 displayed on the display unit 104 as illustrated in FIGS. 19and 20A, the tag information adding unit 110 d preferably adds a featurepoint of the facial area F1 of the touched face to tag information of apermission ID of portrait rights as the biological information. Inaddition when the subject P1 touches the biological information detector107 as illustrated in FIG. 20B, the tag information adding unit 110 dpreferably adds the biological information detected by the biologicalinformation detector 107 as the tag information. After step S205, theimaging device 100 causes the process to return to the main or startroutine of FIG. 13.

When it is determined in step S204 that the biological informationdetector 107 has not detected the biological information of the subjectP1 (No in step S204), the tag information adding unit 110 d preferablyadds non-confirmation information indicating that the subject's portraitrights are not confirmed, to the tag information (step S206). After stepS206, the imaging device 100 causes the process to return to the main orstart routine of FIG. 13.

When it is determined in step S203 that the face in the image displayedon the display unit 104 is not touched (No in step S203) and a specifiedperiod of time, for example, 5 seconds elapses (Yes in step S207), theimaging device 100 preferably causes the process to return to the mainor start routine of FIG. 13.

When it is determined in step S203 that the face in the image displayedon the display unit 104 is not touched (No in step S203) and thespecified period of time does not elapse (No in step S207), the imagingdevice 100 preferably causes the process to return to step S203.

Returning to FIG. 13, step S128 and subsequent steps will be described.In step S128, the communication unit 109 preferably transmits the imagefile including the tag information to the image reception server 200.After step S128, the imaging device 100 causes the process to proceed tostep S115.

When it is determined in step S101 that the imaging device 100 is notset to the shooting mode (No in step S101), the imaging device 100 isnot set to the playback mode (No in step S116), and the imaging device100 is set to a communication destination setting mode (Yes in stepS129), the tag information adding unit 110 d preferably causes personalinformation of the owner of the imaging device 100, such as, withoutlimitation, a mail address of the mobile device 500 of the owner of theimaging device 100 and an owner name and a telephone number of theimaging device 100, to be recorded in the personal information recordingunit 108 d in response to an instruction signal input from the touchpanel 105 or the input unit 103 (step S130).

The tag information adding unit 110 d sets a designation page on whichthe image file is displayed through the image display server 400 at stepS131. After step S131, the imaging device 100 causes the process toproceed to step S115.

When it is determined in step S129 that the imaging device 100 is notset to the communication destination setting mode (No in step S129) andthere is access from another device via the network N (Yes in stepS132), the imaging device 100 preferably receives an image file throughthe communication unit 109 at step S133, and causes the received imagefile to be recorded in the recording unit 108 at step S134. After stepS134, the imaging device 100 causes the process to proceed to step S115.

When it is determined in step S132 that there is no access from anotherdevice via the network N (No in step S132), the imaging device 100causes the process to proceed to step S115.

A detailed process executed by the image reception server 200 will bedescribed with reference to FIG. 21 which is a flowchart of a processexecuted by the image reception server 200. As illustrated in FIG. 21,when there is communication from the imaging device 100 via the networkN (Yes in step S301) and an image file is received from the imagingdevice 100 (Yes in step S302), the image reception server controller 203preferably causes the received image file to be recorded in the imagedatabase 202 (step S303).

When the route information added to the tag information of the imagefile represents a route passing through the management server 300 (Yesin step S304), the image reception server controller 203 preferablytransmits the image file recorded in the image database 202 to themanagement server 300 through the network N and the communication unit201 (step S305). After step S305, the image reception server 200 endsthe present process.

When it is determined in step S304 that the route information added tothe tag information of the image file does not represent a route passingthrough the management server 300 (No in step S304), the image receptionserver controller 203 preferably transmits the image file recorded inthe image database 202 to the image display server 400 through thenetwork N and the communication unit 201 at step S306. After step S306,the image reception server 200 ends the present process.

When it is determined in step S302 that no image file is received fromthe imaging device 100 (No in step S302), the image reception servercontroller 203 causes the process to return to step S301.

When it is determined in step S301 that there is no communication fromthe imaging device 100 via the network N (No in step S301) but there iscommunication from the management server 300 (Yes in step S307), theimage reception server controller 203 preferably transmits errorinformation indicating that the confirmation destination information ofthe mobile device 500 of the owner of the imaging device 100 is notadded to the imaging device 100 that has received the image file (stepS308). The photographer or user of the imaging device 100 can preventthe tag information from not being set in advance when the image file istransmitted to the image reception server 200. After step S308, theimage reception server 200 ends the present process.

When it is determined in step S307 that there is no communication fromthe imaging device 100 via the network N (No in step S301) and there isno communication from the management server 300 (No in step S307), theimage reception server 200 ends the present process.

A detailed process executed by the management server 300 will bedescribed with reference to the flowchart in FIG. 22. As illustrated inFIG. 22, when there is communication from the image reception server 200(Yes in step S401) and the image reception server 200 receives data (Yesin step S402), the management server controller 304 receives an imagefile from the image reception server 200 (step S403).

The individual information determining unit 304 b preferably determineswhether or not the confirmation destination information is included inthe image file received from the image reception server 200 at stepS404. When the individual information determining unit 304 b determinesthat the confirmation destination information is included in the imagefile received from the image reception server 200 (Yes in step S404),the management server 300 causes the image file received from the imagereception server 200 to be recorded in the image database 303 at stepS405.

The management server controller 304 transmits a list of pieces of taginformation based on the confirmation destination information to themobile device 500 at step S406. After step S406, the management server300 causes the process to return to step S401.

When the individual information determining unit 304 b determines thatthe confirmation destination information is not included in the imagefile received from the image reception server 200 in step S404 (No instep S404), the management server controller 304 preferably transmitserror information indicating that the confirmation destinationinformation is not added to the transmission destination to the imagereception server 200 at step S407. In this case, when the individualinformation determining unit 304 b determines that there is informationin which the tag information added to the image file received from theimage reception server 200 matches user data recorded in the userdatabase 302, the management server controller 304 may transmit a listof pieces of tag information to the mobile device 500 using theconfirmation destination information of the mobile device 500 recordedin the user database 302. After step S407, the management server 300causes the process to return to step S401.

When it is determined step S401 that there is no communication from theimage reception server 200 (No step S401) but there is communicationfrom the mobile device 500 (Yes in step S408), the management server 300preferably causes the process to proceed to step S409.

When the mobile device 500 receives selection information (Yes in stepS409), the management server controller 304 selects tag informationaccording to the selection information at step S410. For example, whenthe selection information received from the mobile device 500 is thebiological information or the distance distribution information of thetag information, the management server controller 304 selects thebiological information or the distance distribution information frompieces of tag information of the image file received from the imagereception server 200.

The digital watermark generating unit 304 c preferably generates the taginformation according to the selection information and digital watermarkinformation of the confirmation destination information of the mobiledevice 500, and adds the information to the image data (step S411). Atthe same time, the digital watermark generating unit 304 c preferablydeletes or removes the tag information other than the selectioninformation from the image file.

Further, when shooting by the imaging device 100 takes place, it can bevery difficult to identify a person who has operated the imaging device100 to perform shooting. In this regard, in some embodiments, aphotographer or user can be associated with the copyright in aone-to-one manner such that the imaging device 100 acquires informationspecifying a person (photographer or user) who has operated the imagingdevice 100, such as biological information or input information of aphotographer or user who has operated the imaging device 100 at the timeof shooting, and the acquired information can be added as taginformation of captured image data.

There are cases in which a person (subject or model) to be captureddesires to tag, for example, waiver information of portrait rights toimage data (captured image) at the time of shooting. In this case, it isnecessary for a person who has waived the portrait rights to be theperson having the portrait rights. However, when the imaging device 100acquires, for example, biological information including an image of aface of a person who has waived the portrait rights, in addition todetermination as to whether or not the image data matches image data ofthe person who has waived the portrait rights, by using the biologicalinformation (for example, fingerprint information or vein information)of the person who has waived the portrait rights, so-called spoofing inwhich the portrait right waiver is made by a person other than theportrait right holder can be reliably prevented.

Because biological information specifying a photographer having thecopyright or a subject having portrait rights is individual information,most photographers or subjects want individual information specifying anindividual, such as biological information, withheld from publication.Therefore, an image file in which individual information specifying anindividual, such as biological information that is tagged as taginformation, needs be strictly managed.

As described above, special information that requires a photographer oruser's careful handling such as individual information (biologicalinformation) specifying a subject is processed only in a speciallyauthenticated server and is secured (this relates to route information).In addition, coordination with the mobile device 500 (external device)associated with the owner of the imaging device 100 is performed througha specific server (the management server 300), and thus security can befurther improved (this also relates to route information).

As described above, confirmation of image publication to the Internet bythe owner of the imaging device 100 or management of photographer, user,or subject information can be properly performed according to atransmission route through which an image file is transmitted orprocessed. As a result, information or an image file generated by theimaging device 100 of the embodiments can be securely transmitted.

The management server controller 304 preferably transmits the image fileto the image display server 400 through the network N and thecommunication unit 301 (step S412). After step S412, the managementserver 300 causes the process to return to step S401.

When it is determined in step S409 that no selection information isreceived from the mobile device 500 (No in step S409), the managementserver 300 is on standby until selection information is received fromthe mobile device 500.

When it is determined in step S408 that there is no communication fromthe mobile device 500 (No in step S408), the management server 300causes the process to proceed to step S413.

When an instruction for monitoring an image is given from the mobiledevice 500 or an external device (Yes in step S413), the managementserver controller 304 acquires a sample image file and facial featureinformation of the sample image file from the mobile device 500 or theexternal device (step S414).

The image search unit 304 d searches for an image uploaded to thenetwork N through the network N and the communication unit 301 based onthe sample image file and the facial feature point information (stepS415).

When there is an image corresponding to image data of the sample imagefile or a similar image having similar facial feature point information(Yes in step S416), then digital watermark information is preferablyadded to image data of the similar image (Yes in step S417), and if thedigital watermark information is appropriate (Yes in step S418), themanagement server 300 causes the process to return to step S401.

When there is an image corresponding to image data of the sample imagefile or a similar image having similar facial feature information (Yesin step S416) but digital watermark information is not added to imagedata of the similar image (No in step S417), the management servercontroller 304 preferably transmits a deletion instruction signal of atarget image to the image display server 400 through the network N andthe communication unit 301 (step S419). After step S419, the managementserver 300 causes the process to return to step S401.

When it is determined in step S418 that the digital watermarkinformation is not appropriate (No in step S418), the management server300 causes the process to proceed to step S419.

When it is determined in step S413 that no instruction for monitoring animage is given from the mobile device 500 or the external device (No instep S413) and an image purchase desire signal is received from theimage display server 400 (Yes in step S420), the management server 300causes the process to proceed to step S421 which will be describedbelow. However, when it is determined in step S413 that no instructionfor monitoring an image is given from the mobile device 500 or theexternal device (No in step S413) but the image purchase desire signalis not received from the image display server 400 (No in step S420), themanagement server 300 causes the process to proceed to step S422 whichwill be described below.

In step S421, the management server controller 304 preferably transmitspurchase desire information to the mobile device 500 based on addressinformation added to the image file of the purchase desire signal (stepS421). As a result, the owner of the mobile device 500 or the imagingdevice 100 can understand that an image purchaser appears. After stepS421, the management server controller 304 causes the process to returnto step S401.

When it is determined in step S422 that information indicatingpermission of the image file from a copyright holder of the image filedesired to be purchased is received from the mobile device 500 (Yes instep S422), the management server controller 304 preferably executes amediation process of bi-directionally transmitting address informationof the mobile device 600 of a person who wants to purchase and addressinformation of the mobile device 500 of the copyright holder of theimage file (step S423). As a result, the person who wants to purchaseand the copyright holder of the image file can acquire information ofthe other party and directly execute transaction of the image file orthe like. After step S423, the management server 300 causes the processto return to step S401.

When it is determined in step S422 that information indicatingpermission of the image file from the copyright holder of the image filedesired to be purchased is not received from the mobile device 500 (Noin step S422) and there is user registration (Yes in step S424), theindividual information setting unit 304 a executes a registrationprocess of registering the user's individual identification information,tag information, owner information of the imaging device 100, andportrait right information to the user database 302 (step S425). Afterstep S425, the management server 300 causes the process to proceed tostep S401.

When it is determined in step S422 that information indicatingpermission of the image file from a copyright holder of the image filedesired to be purchased is not received from the mobile device 500 (Noin step S422) and there is no user registration (No in step S424), themanagement server 300 causes the process to proceed to step S401.

A detailed process executed by the image display server 400 will bedescribed with reference to the flowchart illustrated in FIG. 23. Asillustrated in FIG. 23, when data is received from the outside via thenetwork N (Yes in step S501) and the transmission source is the imagereception server 200 (Yes in step S502), the image display servercontroller 403 receives an image file from the image reception server200 (step S503).

Thereafter, the image display server controller 403 preferably causesthe image file received from the image reception server 200 to berecorded in the designation page and recorded in the image database 402(step S504). After step S504, the image display server 400 causes theprocess to return to step S501.

When it is determined in step S502 that the transmission source is notthe image reception server 200 (No in step S502), the image displayserver 400 causes the process to proceed to step S505.

when it is determined that the transmission source is the managementserver 300 (Yes in step S505), the image display server 400 causes theprocess to proceed to step S506 which will be described below. However,when the transmission source is not the management server 300 (No instep S505), the image display server 400 causes the process to return tostep S501.

In step S506, the image display server controller 403 receives an imagefile from the management server 300. The copyright information addingunit 403 a preferably adds copyright prohibition information to taginformation of the image file at step S507. The image file received fromthe management server 300 is recorded in the designation page andrecorded in the image database 402 at step S508. After step S508, theimage display server 400 causes the process to return to step S501.

When it is determined in step S501 that no data is received from theoutside via the network N (No in step S501) and there is access to abrowser (Yes in step S509), the image display server 400 causes theprocess to proceed to step S510 which will be described below. However,when it is determined in step S501 that no data is received from theoutside via the network N (No in step S501) and there is no access to abrowser (No in step S509), the image display server 400 causes theprocess to return to step S501.

When there is access from the mobile device 500 or the mobile device 600(Yes in step S510), the display controller 403 d displays the designateddesignation page at step S511. In this case, the display controller 403d preferably adds advertising to the designated designation page, anddisplays the designated designation page including advertising.

When an instruction signal indicating another page is input (Yes in stepS512), the display controller 403 d preferably adds advertising toanother page in response to the instruction signal, and displays thepage including advertising at step S513.

When comment information is received from the mobile device 500 or themobile device 600 (Yes in step S514), the image display servercontroller 403 includes the comment information in the designation page,and causes the designation page including the comment information to berecorded in the image database 402 at step S515.

When browser access of the mobile device 500 or the mobile device 600ends (Yes in step S516), the image display server controller 403executes an end process of recording the designation page in the imagedatabase 402 at step S517. After step S517, the image display server 400causes the process to return to step S501.

When it is determined in step S516 that browser access of the mobiledevice 500 or the mobile device 600 does not end (No in step S516), theimage display server 400 causes the process to proceed to step S518.

When an image is selected through the mobile device 500 or the mobiledevice 600 (Yes in step S518) and there is copyright prohibitioninformation (Yes in step S519), the display controller 403 d displaysinformation indicating that copying is prohibited to be superimposed onthe image at step S520. More particularly, as illustrated in FIG. 24,when the user of the mobile device 500 selects the image W1 through thetouch panel 503, information indicating that copying is prohibited ispreferably displayed to be superimposed on the image W1. As a result,the owner of the mobile device 500 or the mobile device 600 canintuitively understand the selected image is protected by the copyright.

When purchase of an image is requested from the mobile device 600 (Yesin step S521), the image display server controller 403 transmits thepurchase desire information to the management server 300 at step S522.After step S522, the image display server 400 causes the process toreturn to step S501.

When it is determined in step S521 that the mobile device 600 does notrequest to purchase an image (No in step S521), the image display server400 causes the process to return to step S501.

When it is determined in step S518 that an image is selected (Yes instep S518) and there is no copyright prohibition information (No in stepS519), the image display server controller 403 transmits the selectedimage file to the mobile device 600 at step S523. More particularly, asillustrated in FIG. 25, when the user of the mobile device 600 selectsan image W2 through the touch panel 503 and no copyright prohibitioninformation is included in the image W2 (copyright free), the image fileof the image W2 is transmitted to the mobile device 600. After stepS523, the image display server 400 causes the process to return to stepS501.

When it is determined in step S512 that an instruction signalrepresenting another page is not input (No in step S512), the imagedisplay server 400 causes the process to proceed to step S514.

When it is determined in step S514 that comment information is notreceived (No in step S514), the image display server 400 causes theprocess to proceed to step S516.

When it is determined in step S510 that there is no access from themobile device 500 or the mobile device 600 (No in step S510), the imagedisplay server 400 causes the process to proceed to step S524.

When there is access from the management server 300 (Yes in step S524)and a deletion instruction is received (Yes in step S525), the imagedata deleting unit 403 b deletes an image according to the deletioninstruction from the image database 402 at step S526. As a result, animage file that infringes the copyright can be deleted. After step S526,the image display server 400 causes the process to return to step S501.

When it is determined in step S524 that there is no access from themanagement server 300 (No in step S524), the image display server 400causes the process to return to step S501.

When it is determined in step S525 that no deletion instruction isreceived (No in step S525), the image display server 400 causes theprocess to return to step S501.

According to the above-described embodiments, image data that is notintended to be posted by a photographer or user can be prevented frombeing posted to a server.

According to some embodiments, as the tag information of the image filetransmitted from the imaging device 100 is deleted and the image file istransmitted to the image display server 400 through the image receptionserver 200, the image file in which the copyright is waived can betransmitted (posted) to the image display server 400.

According to some embodiments, since the tag information is deletedbefore the imaging device 100 transmits the image file to the imagereception server 200, even when another user browses in the designationpage of the image display server 400, personal information can beprevented from leaking.

According to some embodiments, an image file is transmitted to the imagedisplay server 400 through the image reception server 200 and themanagement server 300 according to route information of tag informationof the image file transmitted from the imaging device 100. Thus, theimage file can be transmitted to the image display server 400 in thestate in which the copyright is protected.

According to some embodiments, even when a photographer or other personintentionally or innocently infringes the portrait rights of another bytaking a picture of a subject or capturing a poster and thentransmitting (posts) an image file including image data to the imagedisplay server 400, since the management server 300 transmits distancedistribution information of tag information to a mobile device of aportrait right holder that is illustrated on a photograph or a poster,it is possible to prevent image data which is not intended by theportrait right holder from being posted to the image display server 400without permission in advance or immediately after posting is detected.

According to some embodiments, even when an image file including imagedata captured by a photographer without a subject's permission istransmitted to the image display server 400, the management server 300gives notification to a mobile device of a subject corresponding apermission ID of tag information, and thus the image file is transmittedto the image display server 400 with at least some basis for having asubject's permission. As a result, image data can be prevented frombeing published on a web site in a state in which subject's portraitrights are ignored.

According to some embodiments, even when a photographer or user otherthan the owner of the imaging device 100, for example, an assistant ofthe owner performs shooting using the imaging device 100, the owner ofthe imaging device 100 selects personal authentication information andgives approval, and thus an image file can be transmitted to the imagedisplay server 400 in the state in which the copyright of the image fileis protected.

According to some embodiments, the management server 300 generates adigital watermark of personal authentication information selected by themobile device 500, and transmits an image file in which individualinformation used to authenticate an individual with tag informationincluding the digital watermark is deleted to the image display server400. Thus, even when another user browses in the designation page of theimage display server 400, personal information can be prevented fromdissemination.

The imaging device of some embodiments can be applied not only to adigital single-lens reflex camera but also to any electronic device thatcaptures an image such as, without limitation, a digital camera with anattachable accessory, a digital video camera, a virtual camera, a mobiletelephone or smart phone with an imaging function, a computing device,or a tablet type mobile device.

Programs executed by the imaging device and the management server ofsome embodiments are file data of an installable format or an executableformat, and are provided such that a corresponding program is recordedin a computer readable recording medium such as, without limitation, aCD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), aUSB medium, or flash memory.

The programs executed by the imaging device and the management server ofsome embodiments may be configured to be provided such that acorresponding program is stored in a computer connected to a networksuch as the Internet and downloaded via the network. In addition, theprogram executed by the imaging device of some embodiments may beconfigured to be provided or distributed via a network such as theInternet.

The image reception server, the management server, and the image displayserver of some embodiments are individually operated, but the imagereception server, the management server, and the image display servermay be operated through a single server.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. An image management server comprising: a receiverconfigured to receive an image file comprising: image data; copyrightinformation; and tag information including route information fortransmitting the image data, wherein the image file is transmitted by anexternal device in accordance with the route information; a processorconfigured to add digital watermark information to the image data tomake the image file in a state in which the copyright information isprotected or waived; and a transmitter configured to transmit the imagefile to an image display server in the state in which the copyrightinformation in the image file is protected or waived.
 2. The imagemanagement server according to claim 1, wherein the transmittertransmits a list of the tag information included in the image file to amobile device, the receiver receives a selection of the tag informationin the list from the mobile device, and the processor converts theselected tag information into digital watermark information and adds thedigital watermark information converted from the selected taginformation to the image data.
 3. The image management server accordingto claim 1, wherein the transmitter transmits the image file to theimage display server in the state in which the copyright information inthe image file is protected in accordance with the route information. 4.The image management server according to claim 1, wherein the addeddigital watermark information prohibits the copying of the copyrightinformation in the state in which the copyright of the image file isprotected.
 5. The image management server according to claim 1, whereinthe added digital watermark information permits copying of the copyrightinformation in the state in which the copyright of the image file iswaived.
 6. An image management method comprising: receiving an imagefile comprising: image data; copyright information; and tag informationincluding route information for transmitting the image data, wherein theimage file is transmitted by an external device in accordance with theroute information; adding digital watermark information to the imagedata to make the image file in a state in which copyright of the imagefile is protected or waived; and transmitting the image file to an imagedisplay server in the state in which the copyright of the image file isprotected or waived.
 8. The image management method according to claim6, wherein the added digital watermark information prohibits the copyingof the copyright information in the state in which the copyright of theimage file is protected.
 9. The image management method according toclaim 6, wherein the added digital watermark information permits copyingof the copyright information in the state in which the copyright of theimage file is waived.
 10. An imaging device comprising: an imagingsensor configured to generate image data; and a processor configured togenerate an image file comprising the image data and tag information,the tag information comprising route information for transmitting theimage file.
 11. The imaging device according to claim 10, furthercomprising a transmitter configured to transmits the generated imagefile to an image management server in accordance with the routeinformation.
 12. The imaging device according to claim 10, furthercomprising a transmitter configured to transmits the generated imagefile to a plurality of transceiving devices in accordance with the routeinformation.
 13. The imaging device according to claim 12, wherein theplurality of transceiving devices comprise: an image reception serverthat receives the image file transmitted from the transmitter andtransmits the image file based on the tag information; an imagemanagement server that receives the image from the image receptionserver, manages the image file based on the tag information, andtransmits the image file based on the tag information; and an imagedisplay server that receives the image file from the image receptionserver or the image management server and transmits information relatingto the image file in accordance with the tag information to an externaldevice.
 14. The imaging device according to claim 13, wherein thegenerated image file further comprises copyright information; theprocessor is further configured to add digital watermark information tothe image data to make the image file in a state in which the copyrightinformation is protected or waived; and the transmitter transmits theimage file to the image display server in the state in which thecopyright information in the image file is protected or waived.